RATIONAL SMOOTHNESS OF VARIETIES OF 
REPRESENTATIONS FOR QUIVERS OF DYNKIN TYPE 



PHILIPPE CALDERO AND RALF SCHIFFLER 

Abstract. Let U+ be the positive part of the quantized enveloping algebra 
U of type A, D or E. The change of basis between canonical, and PBW-basis 
of U+ has a geometric interpretation in terms of local intersection cohomo- 
logy of some affine algebraic varieties, namely the Zariski closures of orbits of 
representations of a quiver of type A, D or E. In this paper we characterize the 
rationally smooth orbit closures and prove in particular that orbit closures are 
smooth if and only if they are rationally smooth. This provides an analogue of 
theorems of V. Deodhar, and J. Carrell and D. Peterson on Schubert varieties. 



1. Introduction 

Let F be an algebraically closed field, d = (di,d 2 , . . . ,d n ) £ N™ and Gd = 
n™=i Gi<j 4 (F). Let Q be a fixed quiver whose underlying graph A is the Dynkin 
graph of type A n ,D n or E n . Gd acts on Ed = ®i^j e Q~}Iomw{F d ' ,W dj ), by conju- 
gation. Let O be a Gd-orbit and O its Zariski closure. In |BS| the complete list of 
rationally smooth orbit closures of type A n was obtained. As a consequence it was 
shown that, in type A n , O is rationally smooth if and only if O is smooth. In this 
paper we will generalize these results to the types D n and E n , see theorem 13 . 61 and 
corollary 13. 71 

Rational smoothness is a topological property, which is defined using local in- 
tersection cohomology, and has been extensively studied for Schubert varieties, 
|Deo85| . |Car94| . For a survey of some of these results, see | BL00| and |Bri98j . 

Let U + be the positive part of the quantized enveloping algebra U over Q(v) 
associated by Drinfeld and Jimbo to the root system of type A. Kashiwara and 
Lusztig have constructed independently of each other a unique canonical basis B of 
U + in |Kas91j and |Lus 90a . For each reduced expression i of the longest element 
w of the Weyl group W of type A, there is also a PBW-basis B{. Some of the 
reduced expressions are adapted to the quiver Q. In this case, Lusztig has shown 
in Lus90a that the entries of the transition matrix between the bases B and B\ 
have a description in terms of local intersection cohomology of orbit closures. We 
use this approach to study rational smoothness of orbit closures. One important 
ingredient therefore is the action of the bar involution of U on the elements of the 
PBW-basis. 

This paper is organized as follows. In section 2 we fix notations and recall some 
results that we will need at a later stage. In particular, we recall the Hall algebra 
realization of U + . We then present two different approaches to study rational 
smoothness of orbit closures: one algebraic and the other geometric. 
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Section 3 contains the algebraic approach. Here we consider the bar of a PBW- 
basis element as a linear combination in the PBW-basis, and study the coefficients 
of this expansion; to be more precise, we calculate the derivative at v = 1 of these 
coefficients. The method used to calculate the coefficients differs from |BS) . In 
fact, we use the dual approach, with the help of the canonical form on U + . Indeed, 
the dual PBW-basis is known in the Hall algebra context by |Gre95j . Moreover, 
the adjoint a of the bar involution is a Q-antiautomorphism (up to a power of q) 
given by Lusztig, |Lus93j . The reason why things are more convenient when we 
dualize is that the dual of an irreducible element of the PBW-basis is an element 
of the dual canonical basis, Cal , and so is stable by a. Then, the image by a of a 
general dual PBW-basis element can be easily calculated by the antiautomorphism 
property. This enables us to realize the desired coefficients in terms of generalized 
Hall polynomials, see Proposition ^. II Using the same methods as in |BS| . we then 
obtain the complete list of rationally smooth orbit closures. It is easy to see that 
each orbit closure in this list is smooth. 

In section 4 we present another proof of this characterization using a geometric 
approach. According to an idea of Michel Brion, we calculate the Euler-Poincare 
characteristic of the projectivization of the orbit closures O. Indeed, it is known 
that, for rationally smooth cones, the Euler-Poincare characteristic of the projec- 
tivization of the cone equals the dimension of the cone. Thanks to a theorem of 
Deligne on the Weil conjecture, the characteristic can be calculated by counting the 
number of F g -rational points of an orbit closure viewed as a variety on an algebraic 
closure ¥ q of ¥ q , and specializing at q = 1. This method provides a geometric 
interpretation of the proof given in BS, and followed in 3. It also provides an 
interesting homological realization of algebraic elements, namely the derivative at 
q = 1 of the coefficients of the bar involution in the PBW-basis. 

Our main result, Theorem 13.31 generalizes |BS1 Theorem 5.4]. Nevertheless, the 
E-case slightly differs from the A-D case. Let's explain how. First of all, by Ringel's 
Hall algebra approach of quantum groups, the coefficients of the bar automorphism 
discussed above are parameterized by couples (O, O') of G<j orbits, and are non zero 
if and only if O' -< O for the so-called degeneration ordering. Now, Klaus Bongartz 
gave, |Bon95j . a description of this ordering in the representation theory of the 
quiver Q. In particular, we can define "elementary degenerations" corresponding 
to certain non-split exact sequences, called elementary operations, in the Auslander- 
Reiten quiver of Q, and O' -< O if and only if there exists a chain of elementary 
degenerations relying O' and O. The results in |BSj proves that the coefficient 
parameterized by (O, O') "sees" the minimal length of such a chain, and that the 
derivative at q = 1 of the coefficient is non zero if and only if the degeneration 
corresponding to (O, O') is elementary. In order to generalize this result, we have 
to replace elementary degenerations by a finer notion, see 3.2. 



2.1. The quantized enveloping algebra U. Let A be a Dynkin diagram of type 
A, D or E, let n be the number of vertices of A and let (<%■) be the corresponding 
Cartan matrix. Thus 



2. Notations and recollections 




if i = 3 

if i — j is an edge in A 
otherwise. 
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Let v be an indeterminate and U the quantized enveloping algebra of Drinfcld- 
Jimbo of type A over the field Q(v) of rational functions. U is a (Q(w)-algebra with 
generators: E i7 F i7 Ki, K^(l < i < n) and relations: 

(r.l) KiKr 1 = K~ 1 K i = 1, K t K 3 = KjKf, 

(r.2) KiEj=v a »EjKi 
(r.3) KiFj = v~ a ^ 



(r.4) EiFj - FjEi = 4r^ where <S W = 



( Ki - K- 1 ) J 1 ift=j 

- -r— where — < „ . r . . . 



(r.5) 



(r.6) 



EfEj -{v + v-^EiEjEi + EjEf = if ay = -1 
E i E j -E j E i = 

if - (« + v- 1 )F l F J F l + F 3 Ff = if ay = -1 

/•;/•;, - /•,/•; = o, if ay ^ -1 



Let U + be the Q(u)-subalgebra generated by the Ei (1 < i < n). Let ( ) : 
U — > U be the involution of Q-algebras defined by 

Ei i ► Fj i — ► jPf, Jfi i — > for all 1 < i < n and v \— * v" 1 . 

Note that U+ = U+. 

Let Q, resp. Q + , be the free abelian group, resp. semigroup, with basis 
{ai, a2, . . • , a n }. Define an inner product ( , )q on Q by {&i,(Xj)Q = &y- Let 
R = {a G Q | (a, ol)q — 2}. i? is a root system of type A whose set of simple roots 
is {ai, a2, . . • , a n }- Let R + = {a G R | a = . c_,cy with <y G N} be the subset of 
positive roots. 

Each a G R defines a reflection s a : Q — > Q, z i— > z — (z, o;)q a. We will write 
Si instead of s ai . Let W be the Weyl group of R. This is the subgroup of Aut(Q) 
generated by the reflections sy (1 < i < n). Let £(io) be the length of w with 
respect to the generators {si, s%, . . . , s n } and denote by wq the unique element of 
W of maximal length. It is known that 1(wq) = v = ^(R + ). Let Tr be the linear 
form on Q + such that Tr(aj) = 1, 1 < i < n. 

We shall use the Q + -g ra dhig wt of U + defined by wt(Ei) — ai. 

Lusztig has defined an action of the braid group on U LusQOa) and used it to 
define bases of PBW type of U + . We now recall these definitions. 

For i G {1, . . . , n}, let Tj : U — > U be the automorphism of Q(w)-algebras defined 

by 

Ei h-> -K^Fi , Fi h-» -EiKi , K, ^ Kr 1 , 

Ej i— > Ej, Fj t— > Fj, Kj i— » Kj, if ay = 0, 

Ej » (EjEi - v^EiEj), Fj ^ (FiFj - vF s Fi), K s ~ K,K 3 , if ay = -1. 

We have T{FjTi = TjTiTj if ay = — 1 and 2jTj = TjTj if ay 7^—1- This gives 
us a braid group action. Moreover Ti(Ej) = T^ 1 (E i ) if ay = — 1. 
Given integers M, AT > 0, we define 



N i h 



M + JV 
TV 



[M + AT1! 
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and E\ N) = —!— for 1< i < n. 
[N]\ 

Let X be the set of sequences i = (i%, . . . , i v ) of elements in {1, . . . , n} such that 
. . . st v is a reduced expression of w$. Each i £ I gives rise to a total order on 
R + = {a 1 , . . . , where a* = Si 1 st 2 ■ ■ ■ Si t l (a^ ) for t = 1, . . . , v. We say that an 
element c = (c\ , . . . , c v ) € W is of i- homogeneity d = (di, . . . , d n ) € N n if 

1/ n 

^ c t a* = d k ak ■ 

6=1 fc=l 

Let b(t) be the vector (0, . . . , 0, 1, 0, . . . , 0) 6 W whose only nonzero component is 
in the t th column and is 1, where 1 < t < v. 

For i = (ii, . . . , i v ) £ I and c = (c%, . . . , c v ) € W , define 



E 



N 



Note that if c is of i-homogeneity d then Tr(wt(-E; c )) = Y^k=i dk 



,c t b(t) 

t=i 



Proposition 2.1. Let i e I. Then B x = {Ef | c 6 W} is a Q(v)-basis o/U+. We 
say that B\ is a basis of PBW type. 

Proof. |Lus90bl sect. 1.8 and 1.13] □ 

We now recall Lusztig's construction of the canonical basis of U + . 

Theorem 2.2. Let i el and L\ the l\v~ 1 \-submodule o/U + generated by B{. 

(i) Li is independent of i. We denote Li by L. 

(ii) ir(Bi) is a "E-basis of L/v^ 1 L independent of i. Here ir : L — > L/v~ 1 L is 
the canonical projection. We denote ir(Bi) by B. 

(iii) The restriction of ir : L — > L/v~ 1 L defines an isomorphism of 'L-modules 
7r' : L (~l L — > L/v~ 1 L where L is the image of L under (). In particular, 
B = 7r /_1 (S) is a Z-fccms ofLDL. 

(iv) B is a Z[u ]-6asis o/ £ and a Q(v)-basis of U + . B is said to be the 
canonical basis of U + . 

(v) Each element of B is fixed by ( ) : U + — > U + . 

Proof. |Lus90a| □ 

2.2. Specialization at u = 1. Let A = Q[v]r v _u denote the subring of Q(v) 
consisting of functions regular at v = 1. Define the .4- form of U + to be the 
.A-subalgebra of U + generated by E%, 1 < i < n. Denote by = JJ^/(v — 
l)U^t the specialization of U + at v = 1. This is the positive part of the classical 
universal enveloping algebra of type A, with generators E%,... ,E n and classical 
Serre relations 



EfEj - 2 EiEjEi + EjEf = if a l3 = -1 

/•:,/•:, /•:,/'.', o ' : .f«.., * 1. 



Note that in Ui, Ti(Ej) becomes the usual bracket EjEi — EiEj and the special- 
ization Bi(l) = {E?(l) | c e N"} of the PBW-basis is a PBW-basis of Ui. 
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2.3. Quiver modules. Let Q — (Q°, Q 1 ) be a quiver whose underlying graph is 
A, i.e. for each edge {i, j} of A we fix an orientation. (We use the notation Q° for 
the set of vertices of the quiver Q and Q 1 for the set of arrows.) A vertex i E Q° 
is a sink (respectively a source) of Q if there is no arrow i — * j (respectively i <— j) 
E Q 1 . An element i = (i\, . . . ,i v ) S X is adapted to the quiver Q if i\ is a sink of 
Qi = Q and ik is a sink of the quiver Qk = Si k _ 1 (Qk-i) obtained from Qk-i by 
reversing the orientation of all arrows ending at ik~i, where 2 < k < v. It is easy 
to see that there is an element i £ I adapted to Q and that an element i of X can 
be adapted to at most one quiver. 

For the rest of this paper, let i be adapted to the quiver Q. 

Let F be any field. A module (or representation) V = (VI, fij) of Q is a collection 
of n finite dimensional F- vector spaces Vi, (1 < i < n) and of (n — 1) F-linear maps 
fij '■ Vi —> Vj, (i — > j G Q 1 ). A morphism from the module V = (Vi, fy) to the 
module V = (V/ , //•) is a collection of F-linear maps gt : Vi — > V(, 1 < i < n such 
that f-j o gi — gj ° /y for each i —> j E Q 1 . These modules and morphisms form an 
abelian category Mod(Q). If V is a module of Q, denote by [V] its isomorphism 
class in Mod(Q). 

The dimension of the module V = (V., fij) is the n-tuple 

dim(V) = (dim F (V l ), dim F (y 2 ),...,dim F (K)) € N n . 

A module V of Q is indecomposable if V cannot be written as the direct sum of 
proper submodules. 

Theorem 2.3. (i) For all a G R + , there is a unique indecomposable mod- 
ule (up to isomorphism), denoted e a G Mod(Q), such that dim(e a ) = 
(dl, . . . , d n ) and a — X)"=i an V indecomposable module is isomorphic 

to e a for a unique a. This is Gabriel's theorem. 

(ii) There exists an ordering a , 1 < t < v of the positive roots such that 
Homg(e Q t,e Q s) = if s <t. 

(iii) There exists a bijection c = (ci, eg, . . . , c„) i— > [e(c)] between and the set 
of isomorphism classes of modules of Q, where e(c) = ©^ =1 Ct e Q t. /tt, i/iis 
case, dim(e(c)) = (di, . . . , d n ), where J2t=i c * a * = Si=i ^ *- e - c * s °f 
{-homogeneity d. 

In particular, the classification of indecomposable modules is independent of the 
ground field. 

Proof. |Lus90al sect. 4.12 - 4.15] □ 

Set [V, V] = dim F Hom Q (V, V) and [V, V'] 1 = dim F Extg(V, V). Note that 
Homg(V, V) is the F-vector space of morphisms g : V — > V in Mod(Q) and 
Ext^(V,V) is the F-vector space of extensions O^V'^E^V— >0in 
Mod(Q). 

For d = (di, . . . , dn) G N n , define 

n 

E d = Homp(F di , F dj ) and G d = 'jjGL dt {F). 

The group G d acts on E d by (g ■ >j = (gj fij <? t ~ )i—tj- An element of E d can be 
seen as a module in Mod(Q) of dimension d. Two elements of E d define isomorphic 
modules if and only if they are in the same Gd-orbit. By theorem l2.3l there exists 
a bijection between the set of ^-tuples c = (ci, . . . , c v ) of i-homogeneity d and the 



6 



PHILIPPE CALDERO AND RALF SCHIFFLER 



set of Gd-orbits in Ed, where c = (ci, . . . , c v ) corresponds to the orbit O c whose 
elements are isomorphic to e(c). 

There is a partial order on W given by c' ^ c if c' and c have the same i- 
homogeneity and the orbit O c > is contained in the Zariski closure O c of O c . This 
is the so-called degeneration ordering. 

Let S be the set of non-split short exact sequences of modules of Q and let Op 
be the subset of S consisting of all sequences for which the first and the last module 
are indecomposable. Hence if T £ Op then 

T : -> e a s -> V -> e a t -> 

for some s,t 6 {1, . . . , v} and some module V. The elements of Op are called 
elementary operations. For T : — * e a s — > V — > e a t — ► € Op define in(T) = s 
and out(T) = t and denote by op T the vector (opj, . . . , opj) e given by 

f -1 if r = s,t 
opj = < 1 if e a r is a direct summand of V 
[ otherwise. 

For all c E W define Op(c) = {T E Op | c + op T e N"}. Thus an elementary 
operation T E Op(c) allows us to go from one orbit O c to another orbit O c + p T - 
As we will see in Theorem 12.41 below, elementary operations do not only preserve 
the i- homogeneity but they are also compatible with the partial ordering ^. 
The following theorem is shown in [Bon95 . 

Theorem 2.4. Let c, c' E N' y . Then the following four statements are equivalent: 

(i) c' r< c 

(ii) There is a sequence of elementary operations Ti, T2, ■ • • , such that T; E 

Op(c' + Y^iZi °p Ti ) and c ' + Z)t=i °p Ti = c 

(iii) [e Q ,e(c')] > [e Q ,e(c)] /or all indecomposable modules e a . 

(iv) [e(c'),eo.] > [e(c),e Q ] for all indecomposable modules e a . 

2.4. Hall algebras. Fix a quiver Q and a j^-tuple i adapted to Q. Let 7ig = TL 

be the twisted Hall algebra associated to the quiver Q. TL is the free Q(t>)-module 
with basis B the set of isomorphism classes of representations of the quiver Q, with 
multiplication 

(2.1) [e(c')] • [e(c")] = v<^'^ c "> £ F c c , c „ [e(c)] 

c6N" 

where < e(c'),e(c") > = dimp 2 Horn (e(c'), e(c")) — dimp a Ext (e(c'), e(c")) and 
c // is the number of submodules of e(c) that are isomorphic to e(c") and are such 
that the corresponding quotient module is isomorphic to e(c'), as representations 
over F. u 2 . This defines polynomials F£, c „ which are called Hall polynomials. 

Theorem 2.5. There exists an isomorphism r\ : U + — > TL of Z n -graded Q(v)- 
algebras such that ry(-E'i) = [e Q J. It maps Ef to u [ e ( c )' e ( c )]-' I,r C wt ( B i , ))[e(c)]. 

Proo/. |H.in9a||nre95l □ 

We shall need the following corollary, see jCalj : 

Corollary 2.6. Up to a power ofv, the Ef ' -coefficient 0/^=1 * s ...c k ( v2 )> 
where the polynomial F£ t Cfc (q) denotes the number of filtrations of e(c') with 
successive quotients isomorphic to e(ci), . . ., e(cfe) over ¥ q . 
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2.5. Coalgebra structure. Define an algebra structure on U + (8>q(„) U + by 
(x ® x').{y <g> y') = w (wt(»'),wtCw))^ aJI/ j g 

on homogeneous elements. Let S : U + — > U + ®q( c ) U + be the Q(w)-algebra map 
given by 5(Ei) = Ei <£> 1 + 1 <g> Bj. Now, there exists a unique Q(w)-bilinear form 
( , ) on U + such that (E i7 Ej) = Sij(l — v^ 2 )^ 1 and (x,yy ; ) = (8(x),y®y'), where 
( , ) is extended to U + ® U + by the rule (x ®x',y® y') = (x, y).(x' ,y'). 

The Hall algebra approach of the quantum algebra U + gives a nice description 
of its coalgebra structure, lGre95j. For every representation e(c) of the quiver Q, 
let a c (v 2 ) be the number of automorphisms of e(c) as a representation over F.„2. 
Recall |Rin90| that 

V 

(2.2) ttc( „^„2E s<lWik ,e at ]T| |Gics(fB!)) | 

s=l 

We have |Rei99| : 

(2.3) {Ef, Ef) = 5 CtC > v 2[e(c) ' e(c)] adv 2 )- 1 . 

This proves that the basis B\ is orthogonal. We can define the dual basis for this 
pairing = {Ef*,c e W}, with 

(2.4) Ef* = u -2[e(c),e(c)] ^2 

This implies that the algebra U + is generated by E^"^* ', 1 < s < v, with straigh- 
tening relations : 

(2.5) £ G b( t ), b ( s )^r- 

b(t)+b(s)Xc 

In order to understand those straightening relations, we have to define another poly- 
nomial. Let — > e(c') — > e(c) — > e(c") — > be a non-split exact sequence of repre- 
sentations of Q. Then, the set of points Cf.,, c , in the F^-space Ext 1 (e(c"), e(c')) 
corresponding to this extension is a cone (minus the zero point). Set 

E c c „^(v 2 ) :=KVI" 
It is known that Ef.,, , is a polynomial. 

Proposition 2.7. Suppose 1 < s < t < v. Then, for all c in N v and up to a power 
of v, we have 

( 1 if c = b(*) + b(t), 

G c H t )M s) = \ E b(t),b( s )(« 2 ) if c = b ( fi ) + b W + °P T for somc T e °P' 
[ otherwise. 

Proof. This is a direct consequence of (|2.4ll and the Riedtmann formula which states 
(2-6) fbW.bW^VbW^jabW^Vc^ 2 )- 1 = ^( t ),b( s )(^ 2 )- 

□ 

Remark 2.8. As the set Cf.,, c , U{0} is a cone, we see that the polynomial Ef,,, c ,(v 2 ) 
can be factorized by v 2 — 1. So, the proposition shows that the *4-space generated 
by the Ef* is an algebra, and its specialization at v = 1 is a (commutative) polyno- 
mial algebra. Indeed, it is known that this specialization is the algebra of regular 
functions on the maximal unipotent group. 
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Now, let a be the Q-antiautomorphism of U + such that o(Ei) — Ei, 1 < i < n, 
a{v) = v . 

Lemma 2.9. Let x, y be homogeneous elements in U + , and let t £ {1, . . . , v}. We 

have 

(i) (x,y) = (_ t; )'n(wt(x)) v %(wt(x),v,t(x)) Q fa a ^y 

(ii) a(E^ (t) ) = (-l)^')- 1 E\ {t \ up to a power of v. 

Proof, (i) is a direct consequence of |Rei99l 4.3] and (hi) is proved in [Call prop. 
2.1]. □ 

2.6. Local intersection cohomology of orbit closures. In this subsection, let 
F be an algebraic closure of a finite field ¥ q with q = p e elements, where p is a prime 
number, and let d = (di, . . . ,d n ) G N". We will write the dimension dim(0 c ) of 
the orbit O c by d(c). 

The results of this subsection have been proved in |Lus90al chap. 9 - 10]. 

Proposition 2.10. Let c£N" be of i-homogeneity d. Then for each c' < c, there 
exists € Z[w,u _1 ] such that 

c' 

Moreover ll>° = 1 and for all c' < c, Sl£, d = v d ( c )~ d ( c i s an element of 
Z[v 2 ,v~ 2 }. 

Theorem 2.11. Let cef be of i-homogeneity d and let £ c 6 B be the unique 
canonical basis element such that 7r(£ c ) = n(Ef). Then 

(i) £ c = ^2 C , Cc' ; where c' runs over the set of elements of of i- 
homogeneity d, = 1 and £ u _1 Z[u _1 ] for c' ^ c. 

(ii) Ifc' £ c, then Q = 0. 

(hi) // ( ) is the Z-linear involution ofTi\v,v~ x \ sending v to v^ 1 , then 

(iv) If c' < c, f is a ¥ q -rational point of the orbit O c > in E^ and Ti.'j is the stalk 
at f of the a-th cohomology sheaf of the intersection cohomology complex 
of the Zariski closure O c of O c with coefficients in ( extended by zero on 
the complement of that closure), where I is a prime number ^ p, and with 
the ¥ q -structure such that the Frobenius map acts as identity on the stalks 
of its 0-th cohomology sheaf at the rational points of the orbit O c , then 

Hf +1 = for all a and */*(•=)-<*(•=')£= = dim(Wf ) v 2a . 

a 

In particular, v d ( c )~ d ( c )£ c , j s a polynomial in v 2 with coefficients in N. 

Definition 2.12. We say that the orbit closure O c is rationally smooth at O c > C O c 
if for all c" such that c' < c" < c we have ^ a dim(TC 2a )v 2a = 1 for a F 9 -rational 
point / e Oc", i.e. if Cc» = v d ^"^~ d ^ for all c" such that c' < c" < c. 
The orbit closure O c is rationally smooth if it is rationally smooth at each O c > C O c , 
i.e. if Cc/ = v d( - c ')- d( - c ) for all c' < c. 
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Remark 2.13. By a result of |BMj . O c is rationally smooth iff for each point x £ O c 
we have 

1 ifi = 2dimO c 



H l (O c ,O c \{x};Q) = 
where H l denotes ordinary cohomology. 



otherwise 



3. Algebraic approach 

This section gives a generalization of results in BSj . We first prove some formulas 
on the coefficients f2|i, . 

3.1. A formula for . We fix a quiver Q and a i^-tuple i adapted to Q as in the 
previous section. For all c in N", set c* := c t h(t), 1 < t < v. An explicit formula 
for can be calculated : 

Proposition 3.1. For every c, c' in W , we have : 

(3.1) n°, =f c v,c-(«- 2 ) ^n^"^" 2 )) ^c^- 2 )- 1 

to a power of v . 

Proof. In the following proof, equalities are up to a power of v. We first write Q^ 1 = 
(i?f, £?'*). Hence, by Lemma |2~51(T). we have = (-l) Tr ( wt ( B r')) (£.<=, fr(£f'*)). 
So, by formula i|2.3|) , it remains to find the coefficient of Ef in the decomposition 
of a(Ef *) in the basis B\. 

It is easily seen that E? * = Ylt=i Ef^^* , up to a power of v. Then, using 
equation l|2.4|l . Lemma |2~§I (ii) and the fact that a Ctb ^(v 2 ) a Cth ^(v 2 ) 1 = (— l) Ct 
up to a power of v, we get 

l 

(3.2) = (Ef, Y[ E.' Mt) *) up to a power of «. 

Finally, using eauation l2.4l Corollary 12. 61 (T) and eauation l2.3l we obtain : 

and the proposition follows. □ 

There is a nice particular case of this formula when e(c') is the sum of two 
indecomposable modules. 

Corollary 3.2. Suppose c' = b(s) + h(t), s < t. Then, up to a power of v, 
(3-3) il c c , = EZ {t)Ms) (v~ 2 ). 

Proof. This is a direct application of the Riedtmann formula, Rie94| . □ 
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3.2. Derivative of f2°, at v = 1. Set 

ec",cV) 



1 



which is a polynomial. Let Opr be the set of regular elementary operations defined 
by 

Opr = {T : -> e Q , - e(c) e Q « -> 0, e b(t))b(s) (l) ^ 0}. 

With the notation above, we set e T := e£( t ) b( s ) (-*-)■ 

By |Nor| . we know that all elementary operations are regular in case A and 
D. This is not true in case E, see remark below. For c in N", define Opr(c) := 
Opr n Op(c). We can now generalize |BSI Theorem 5.4]. 

Theorem 3.3. Let c, c' in N" with same l-homogeneity, then 

(i) tt c c = 1 and =0i/c'Xc. 

(ii) g^r^c' 1—1 7^ if and only if there exists T in Opr(c) such that c = c'+op T . 

(iii) If the condition in (ii) is verified, then g^^c'l — i = — 2c' s cJe T , where 
s = m(T) and t — out(Y). 

Proof. The first formula of (i) is given in Proposition 12 . 1 ()1 For the second formula, 
just remark that the map ( ) specializes on identity at v = 1. 

Let's prove (ii) and (iii). By equation £3 1^7 = (e?, J[\ =v E?' Mt) *^ , up to a 

power of v. Say J2 C " Ef "* = Yl]- V i?. Ctb(t) * is the expansion of Yl] =L , E? th ^* in 
the dual PBW-basis, thus — h°, up to a power of v. Then, since (1) = 0, 
we have g^^c'li>=i = T~^c'k=i) which is non-zero iff the multiplicity of (v — 1) in 
h c c , is one. The above expansion is obtained by performing a certain number of 
straightening relations (|2.5(1 . By proposition 12 . 71 we have 

(1) h c c , = 1, up to a power of v. 

(2) If c = c' + op for some T £ Op with s = in(T), t = out(T), then 

K = E c h{t)Ms) {v 2 ) = (v 2 - iK (t) , b(s) (« 2 ) 

up to a power of v. Then the multiplicity of (v — 1) in h c c , is at least one 
and is equal to one iff T is regular. 

(3) All other h c d have (v — 1) multiplicity at least 2. 

This proves (ii). Now let c = c' + op T with T £ Opr and s — in(T), t = out(T). 
Then the only way Ef* terms appear in our expansion is in the straightening 
relations involving both E { and E i . The number of these straightening 
relations is c' s c' t . Thus, by Proposition 12.71 h d is a sum of c' s c' t terms equal to 
(v 2 — 1) e b ^ b ( s )(f 2 ) up to a power of v. Hence, -^h^, \ v= i — 2 c' s c' t e T . The theorem 

follows since g^fi£,|„=i = _ 5^^c'k=i- 

□ 



Remark 3.4. The formula in (iii) slightly differs from the one in BS because of the 
factor e T . This factor can be obtained from the polynomials calculated in |Nor j . 
In type A, it can only be 1, so this agrees with the formula in |BSj . In type D this 
constant can be equal to 1 or -1. In type E, it can be equal to 1, -1 and 0. 
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3.3. Rational Smoothness. In this section, we will characterize which orbit clo- 
sures O c are rationally smooth. As a consequence, we will show that if O c is 
rationally smooth, then O c is smooth. 

Let u — v 2 . The next proposition has been shown in jBSl Cor 6.4]. We sketch a 
proof of it for completeness. 

Suppose that O c is rationally smooth, then for all c'^cwe have (£, — v dlyC )~ d ( c ) . 
Fix now c' < c. We obtain by Theorcm l2.11l (\\\) that 

^li'u d{ ^- d{c "^ = 1. 

c' ^c" 

By taking the derivative to u evaluated at u = 1, we get by Theorem 13.31 (i) : 
Proposition 3.5. O c is rationally smooth then 

df£ 



E 



du 



= d(c) - d(c') 

u=l 



for all c' < c. 

For a subset J of the set Q} of arrows of the quiver Q, we define 

E d (J) = e E d I fa - o if g Q 1 \ J}. 

The following properties are easily proved and left to the reader. Let J, J' be two 
subsets of the set Q 1 of edges of Q. 

(1) Ea(J) is a linear subspace of of dimension dim(£^d(^)) = Y^u j}ej di dj. 
In particular, Ed(J) is a smooth variety. 

(2) Ed(J) is a Gd-stable closed subset of E d and it is a finite union of Gd- 
orbits. As a consequence and because the field F is algebraically closed, we 
get that there is a unique open dense Gd-orbit in Ea(J). We will denote 
this orbit by 0{J). 

(3) E A { J) C\ E A { J') = E A {JC\J') and E d (J) + E d (J') = E d (J U J'). 

(4) E d (J)CE d (J>) if J C J'. 

(5) £ d (0) = {O} and^ d (Q 1 ) = E d . 

Because of (3) and (5) we see that for each Gd-orbit O c in E d , there is a unique 
smallest subset J(c) of Q} for which O c C E d (J(c)). In fact 

J(c) = f) J. 

o c c.E d (,/) 

Because E d (J) is closed, then O c C E d (J) if and only if O c C E d (J). As a 
consequence, if c" ^< c, then we get easily that J(c") C J(c). Note also that we 
don't necessarily have O c = C(J(c)). In fact, we will prove in theorem 13 . 61 that we 
get this equality precisely when O c is rationally smooth. 

Let c min = (cr n , c!f in , . . . , c" in ) G fT be defined by 



c r n = 



di if q;^ = Q!i for some i, 1 < i < n 
otherwise. 



O c min is the minimal Gd-orbit of E d and it consists of only the identity element of 
E d . 
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Theorem 3.6. (1) We have the equality 



E 



du 



= dim(£ d (J(c))). 



(2) O c is rationally smooth if and only if O c = Ed(J(c)). 
Proof. By theorem 13. 31 



E 



du 



\ ^ „min „min 



Teo F (c mm ) 



C m(T) C out(T) 



e 



"top 1 

Now T G Opr(c min ) iff T G Opr and c™ n T) ^ ^ C£ (T)) i.e. a m ( T > = aj and 
a oMt(T) _ q,^ are s j m pi e roots, c™2U = dj, c^trr) = (ii and there is an arrow 
i — ► j G Q 1 . Moreover T : — > e Qj — > e tti+aj — > e Qi — » and e T = 1. Note also 
that in this situation c mm + op T ^ c iff i — > j G J(c). Thus 



r min 



^ du 



u=l i^jSJ(c) 



v = dim(-E'd(J(c))), 



this proves (1). 

(2) £'d(J(c)) is smooth, hence rationally smooth. 

Conversely if O c is rationally smooth, then applying proposition ^ . 5l for c' = c min 
and using part (1), we get dim(Ed(J(c))) — d(c). Hence O c is the unique dense 
orbit in E d (J(c)), thus ~<D~ C = E d (J(c)). □ 

Corollary 3.7. An orbit closure of type A, D, E is smooth, if and only if it is 
rationally smooth. 

4. Geometric approach. 

We present in this section an independent proof for Theorem l3.6l The interest of 
this proof is that we give an homological realization of the constants calculated in 
the previous section. To be more precise, the derivative of a coefficient f2 at u = 1 
can be seen as an Euler-Poincare characteristic of a complex variety. The principle 
on which the alternative proof works is that if a cone X in C™ is rationally smooth, 
then, the rational cohomology of the projectivization ¥(X) in P™ _1 is the same as 
the rational cohomology of P d where d = dimP(X). 

4.1. Euler-Poincare characteristic. In the following section, the varieties O are 
considered on the field C. We fix c G W of i-homogeneity d. Set X c := P((%\{0}), 
as a complex variety and let X c (¥ q ), resp. X c (¥ q ), be the corresponding variety 
on the finite field ¥ q , resp ¥ q . We know that there exists a discrete valuation ring 
R C C with residue field of characteristic p and a variety X c defined on R such that 
we get the variety X c (¥ q ) over ¥ q and the variety X c over C by the base change to 
SpecF g and SpecC respectively. 

Let x(X c ) be the Euler-Poincare characteristic of the variety X c . Then 

Theorem 4.1. For every c G N" of i-homogeneity d we have 

X (X c ) = dimE d (J(c)). 
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Proof. We first transpose the calculation of x(Xc) in the context of ^-adic cohomo- 
logy with compact support. We have 

dim Q ir(X c ,Q) = dim c irpT C! C) = dim c W c {X Cl C) = dim^ Hl(X c (T q )Me), 

where I is prime to p. Hence, 

(4.1) X (X C ) = Y,(-^YdimH l c (X c (T q )Mi)- 

i 

Fix a prime number p such that I is prime to p. We know that there is an ac- 
tion of the Frobenius Fr on the /-adic cohomology. By the Grothendieck trace 
formula, |Dan961 7.10], we know that 

2 dim Ac 

(4.2) \x c (F p *)\= (-my(Fy e ,K(x c (¥- q ),Q e ))- 

Now, the theorem of Deligne, |Dan96l 8.21], asserts that H l c (X c (¥^),Q e ) is filtered 
by Fr-stable subspace Wij such that the eigenvalues of the Frobenius Fr on the 
successive quotients arc powers of p up to a root of one. So, there exists an N such 
that if e is a multiple of N, the eigenvalues of Fr e are powers of p e . For these e, we 
have 

(4.3) | X c (¥ p .) |= Y L )V* dimtW^/Wy-i). 

Now, we know that | X c (¥ q ) | is a polynomial P c (q). So, the previous equation 
provides a polynomial equality which is true for an infinite number of p e . 

Hence, | X c {¥ q ) |= Y, i<3 (-l) l <7 fc ^ dim(H^ J /W ij _i), which implies by G~U> that 
x(-^c) = -Pc(l)- The proof of the theorem relies now on the following lemma. □ 

Lemma 4.2. For every c € of i-homogeneity d we have 

P c (l) = dim(£! d (J(c))). 

Proof. First of all, let S c be the set of elements c' of i-homogeneity d such that 
there exists T £ Op such that c mm + op T = c' X c. We have : 

S c = {c« 6 J(c)}, 

with 




di — 1 if a s = aj 
dj — 1 if a s = ay 
otherwise. 



We want to calculate P c {q). As O c is a disjoint union of orbits O a ' with c' ^ c, 
we have to count the cardinality of the set of F g -rational points O c >(F q ). This will 
be denoted by Q c '(q), thus P c {q) = Ec-'vcMcQcf?)- Let x' be a point of 

O c '(F„) and let Gd,x' be the isotropy group of x' in Gd- Then, Q c '{q) = /P* 1 i and 

I ^d, x,' I 

it is known that Gd,x' is the group of automorphism of the module e(c'). Hence, 
I Gd,x' |= cL c '(q) is given by 12.2J1 . In particular, the multiplicity of (q— 1) in Q c '(q) 
is E"=i^-Er=i4- 
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We find that every |^j| 9 =i is zero unless c' 6 S c . Using the formula \Q ld di jj = 

(q di — and L'Hospital's rule, we find ^|-|g=i = didj. By the decomposition 

Pc(q) = ^hj Ec».»*^c Qc'(e), w e obtain the lemma. □ 

4.2. Alternative proof. We now explain how the previous theorem gives a geo- 
metric version of the algebraic proof given in BS and in the present paper. First, 
as O c is a cone, we claim that the rational smoothness of O c implies that the 
cohomology of X c is the same as the cohomology of the projective space, i.e. 
dimiT(X c ,(Q) = dimF^P^" 1 , Q). Let's sketch a proof for this claim, fol- 
lowing Bri98 . By Remark 12.131 the rational smoothness property implies that 
H l (O^,O2\{0}) = 0, i / 2d(c), H 2d( -^(O^,O2\{0}) = Q. As ~0~ c is contractible, 
we obtain by a long exact sequence in relative cohomology, that O c \{0} is a rational 
cohomology sphere of dimension 2d(c) — 1. Now, let S 1 C C* acting naturally on the 
cone O c . It is clear that X c and (O c \{0}) / S 1 have the same rational cohomology. 
Hence, a Gysin exact sequence gives H°(X C ) ~ H 2 (X C ) ~ . . . H 2( - d( -^-^ (X c ) ~ Q 
and H 2k+1 (X c ) = 0. This proves the claim. 

Now, x{X c ) = ^(P^- 1 ) = d(c). By Theorem IO this implies that dimG\ = 
dim_E(j(J(c)), and then O c = Ed(J(c)). Once again, this implies that O c is smooth. 
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